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[57] ABSTRACT 

A method of automatically optimizing the controllable 
parameters related to producing printed material on a hard- 
copy output device is provided, along with a hardcopy 
output device configured for implementing this method 
Users require different types of printed objects to have 
different characteristics. Specifically, business graphics need 
to be sharp and vivid, photographic images should look 
realistic, and text must be black, crisp and clear. By 
extracting, analyzing and conditioning data generated during 
a printing stream, the various regions of text, graphics and 
photographic images on a sheet are distinguished, 
characterized, and printed with a custom balancing of color 
pleasing to the human eye for each type of image printed. 

24 Claims, 6 Drawing Sheets 
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AUTOMATIC OPTIMIZATION OF 
HARDCOPY OUTPUT FOR ENHANCED 
APPEARANCE AND THROUGHPUT 

FIELD OF THE INVENTION 

The invention relates generally to a method of automati- 
cally optimizing the controllable parameters related to pro- 
ducing printed material on a hardcopy output device, and 
such a device implementing mis method. 

BACKGROUND OF THE INVENTION 

The term "hardcopy output device" includes a variety of 
printers and plotters, including those using thermal inlqet 
and electrophotographic technologies to apply an image to a 
hardcopy medium, such as paper, transparencies, foils, and 
the like. 

Most earlier hardcopy print devices have parameters that 
balance the competing requirements of throughput, typically 
measured in pages per minute, and the print quality of the 
hardcopy output These parameters also control the render- 
ing of the document into both the graphics format and 
hardware configuration of the particular device. However, 
the optimum settings for these parameters often varies for 
different types of documents. For example, documents with 
only black ink text have a different set of optimum param- 
eters than documents with colored images or business graph- 
ics. 

Most hardcopy print devices have a variety of mechanical 
print modes and rendering or halftoning options that affect 
the throughput and output quality. This is especially true for 
current color printers based on inkjet technology. These 
modes are often under the user's direct control, or they are 
set to default values calculated to provide only adequate 
quality output and throughput for the overall image. In this 
default mode, the earner devices typically had parameters 
selected to optimize the most typical type of document they 
produced, while delivering only acceptable results when 
printing other types of documents. 

When under user control, in theory, the operator optimizes 
the printing parameters through trial and error. While an 
experienced operator may eventually determine the relation- 
ships between each printing parameter and its effects on the 
various types of outputs, this rarely happens. Most operators 
never master an understanding of the complex relationship 
between the numerous controllable printing parameters and 
the quality of the output Indeed, only experts experienced in 
the rendering and printing technology of a particular hard- 
copy device have a good chance of selecting the optimum 
panting parameters, but this task is quite labor intensive. 

Moreover, in the vast majority of earlier color matching 
techniques, it was impossible to vary the print mode settings 
on a page by page basis, or far different elements on a single 
page. Thus, the physical capabilities of hardcopy print 
devices are rarely exercised by the vast majority of opera- 
tors. As a result, often the printed output is of far lower 
quality, and with less throughput, then could have been 
achieved under optimal operating conditions. 

For example, consider a sheet containing text, a business 
chart, and a photographic image. When color matching was 
optimized for the photograph, the business chart suffered a 
loss of vivid color graphics. If instead* the color settings far 
the page were adjusted to deliver a brighter, more saturated 
graphic, then the photographic image lost its lifelike appear- 
ance. Thus, for the main stream operator using the earlier 
hardcopy devices, optimal hardcopy results were rarely if 
ever achieved. 
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SUMMARY OF THE INVENTION 

According to one aspect of the present invention, a 
method is provided of controlling the printing of a hardcopy 
using a hardcopy printing device having print characteris- 
tics. The method includes the steps of supplying a printing 
medium to a printing device and instructing the printing 
device to print a selected image having plural elements on 
the medium. In a distinguishing step, each element is 

1Q distinguished, and in response to this distinguishing step, an 
adjusting step adjusts the instructing step. In an illustrated 
embodiment, the image elements may be distinguished as 
being either textual, grayscale only, color graphic or photo- 
graphic images, with the instructing step being adjusted to 

15 generate a hardcopy output having crisp, clear text and 
grayscale images, sharp, vivid color graphics, and lifelike 
photographic images. 

According to another aspect of the present invention a 
hardcopy print device is provided for implementing such a 

20 method. In an illustrated embodiment, the hardcopy print 
device comprises an inlqet printer. 

An object of an aspect of the present invention is to 
provide a method and hardcopy print device that are easy to 
operate, and which use the full color mixing and matching 

25 capabilities of the print device to provide an optimal hard- 
copy output 

Another object of an aspect of the present invention is to 
provide a color hardcopy which is more vibrant, clear, and 
pleasing to the eye than that obtainable with earlier systems. 

30 An additional object of an aspect of the present invention 
is to provide a method and hardcopy print device that 
discriminates between various types of printed images, such 
as textual, grayscale only, color graphic and photographic 
images, and which selects black and color inks in mixtures 

35 to yield a preferred color reproduction which is pleasing to 
the eye, although not necessarily matching the color dis- 
played on an associated computer monitor. 
A further object of an aspect of the present invention is to 

^ provide an improved method of balancing the color require- 
ments for different components of a selected image on a 
component by component basis, using computer software 
with minimal operator input 

BRIEF DESCRIPTION OF THE DRAWINGS 

45 

FIG. 1 is a perspective view of one form of a hardcopy 
output device, specifically, an embodiment of an inkjet 
printer, of the present invention. 

FIG. 2 is a plan view of one form of a hardcopy output, 
50 having textual, grayscale only, color graphic and photo- 
graphic image components, produced according to the 
present invention. 

FIGS. 3Aand 3B, (collectively, "FIG. 3") comprise aflow 
diagram illustrating one form of the method of the present 
55 invention. 

FIG. 4 is a reproduction of a prior art computer monitor 
display used with earlier color matching systems. 
FIG. 5 is a reproduction of one form of a computer 
60 monitor display in accordance with the present invention. 

DETAILED DESCRIPTION OF A PREFERRED 
EMBODIMENT 

FIG. 1 illustrates an embodiment of a hardcopy printing 
65 device, here an inkjet printer 10, which may be used in an 
office or home environment for business reports, 
correspondence, desktop publishing, and the like. While it is 
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apparent that the printer components may vary from model 
to model, the typical inkjet printer 10 includes a chassis 12 
and a print medium handling system 14 for supplying a print 
medium, such as a sheet of paper 15 (FIG. 2), to the printer 
10. In addition to paper 15, the print medium may be any 5 
type of suitable sheet material, such as card-stock, 
transparencies, mylar, foils, and the like, but for 
convenience, the illustrated embodiment is described using 
paper as the print medium. The print medium handling 
system 14 includes a feed tray 16. an output tray 18, and a w 
series of rollers (not shown) for delivering the sheets of 
paper from the feed tray 16 into position for receiving ink 
from an inkjet cartridge, such as a color ink cartridge 
20 — and/or a black ink cartridge 22. The illustrated color 
cartridge 20 is a tri-color pen* although in some embodi- 3 
ments (not shown), a group of discrete monochrome pens 
may be used, or a single monochrome black pen 22 may be 
used. 

The cartridges or pens 20, 22 are transported by a carriage 
24 which may be driven along a guide rod 26 by a conven- 20 
tional drive belt/pulley and motor arrangement (not shown). 
The pens 20, 22 may be conventional pens, which selec- 
tively deposit one or more ink droplets on a sheet of paper 
15 in accordance with instructions received via a conductor 
strip 28 from a printer controller 30 located within chassis 25 
12, for instance at the location shown in FIG. 1. The 
controller 30 generally receives instructions from a com- 
puter (not shown), such as a personal computer. A monitor 
(not shown) coupled to the computer may be used to display 
visual information to an operator, such as the printer status 30 
or a particular program being run on the computer. Personal 
computers, their input devices, such as a keyboard and/or a 
mouse device (not shown), and monitors are all well known 
to those skilled in the art 

FIG. 2 illustrates an example of a hardcopy output 40 35 
comprising the sheet medium, here paper 15, which has a 
selected image 42 printed thereon. The computer operator 
may select, create and/or edit the image 42 on the computer 
monitor prior to printing. The image 42 may include a 
plurality of components, elements or regions, such as: 40 
textual elements 44, 44' and 44" {referred to herein generally 
as "text 44" unless otherwise noted); a grayscale region, 
such as a business graphic bar chart 45, which has several 
data bars printed in different shades between black and 
white; a color business graphic region, such as a sectioned 45 
pie chart 46; and a photorealistic or photographic color 
component, such as a scenic image 48. Other elements may 
also benefit from being distinguished and processed, as 
described further below, such as line art used in engineering 
and architectural drawings. so 

As mentioned in the Background portion above, in the 
past when a variety of different image types appeared on a 
single page, the earlier color adjustment schemes yielded 
unsatisfactory results. In earlier systems, if the hardcopy 
output 40 were skewed to provide accurate color for tie 55 
photographic image 48, then the vivid color of the graphics 
46 would be washed out, whereas if the printer was skewed 
toward a saturated vivid color for the graphic, the photo- 
graphic image 48 would lose its lifelike appearance. 
Alternatively, these earlier print systems 40 allowed users to 60 
manually adjust the colors, as well as balance quality and 
throughput requirements, in an attempt to provide visually 
appealing images. In reality, very few people ever attained 
this level of sophistication or had the time to implement it on 
a regular basis. 65 

Another difficulty in manually adjusting the colors results 
from using a computer monitor as the composing medium. 
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Color is formed in a totally different manner on a computer 
screen than on a printed page. Computer monitors display 
colors that are combinations of red, green and blue light 
(RGB). The monitor displays the light rays of these raimary 
colors which are then mixed by the human eye in an additive 
fashion and interpreted as a multicolor screen. These RGB 
colors are considered to be additive because their sum in 
balanced amounts is interpreted by the human eye as white 
light 

In contrast, a printer forms colors on a print medium via 
a w subtractive , * mixing of cyan, magenta, yellow and black 
(CMYK). The cyan, magenta and yellow colors are consid- 
ered subtractive because they each absorb all light rays 
except those of the specific color produced. The letter "JC 
represents "true" black provided by pen 22, as opposed to a 
composite black formed by the sum of cyan, magenta and 
yellow in balanced amounts, such as by color pen 20. 
Another significant distinction between monitors and hard- 
copy outputs 40 is the manner in which the various grada- 
tions of colors are formed. A monitor provides a relative 
continuum of color levels using the RGB components (e.g. 
256 or more variations), whereas the hardcopy printer 10 
may have only discrete color control provided by selectively 
placing as few as three colors (cyan, magenta and yellow) on 
the sheet 15. 

In the past, color matching schemes attempted to produce 
a hardcopy output which had colors matching those appear- 
ing on the computer monitor. This **what you see is what you 
get" ("WYSIWYG") operational philosophy provided hard- 
copy outputs which were not visually pleasing. Independent 
research contracted by the assignee of this patent application 
discovered two important concepts that challenged this 
traditional WYSIWYG assumptions. First, the hardcopy 
output 40, not the screen image, is considered to be the 
critical measurement of the users work. Second, while color 
matching between the printer and screen is important, users 
consistently preferred that the hardcopy 40 have brighter 
more vivid colors, rather than less vivid, perfectly-screen- 
matched colors. Users also demand that graphics 46 be 
vibrant, and photographic images 48 be natural and lifelike, 
even when they both appear on the same page. 

To accommodate these competing desires, the printer 10 
incorporates a method of operating the controller 30 which 
is illustrated with reference to flow chart 50 in FIGS. 3A and 
3B (collectively, "FIG. 3"). Generation of the hardcopy 
output 40 from a computer file or screen display typically 
involves several steps. These steps may occur in a printer 
driver (not shown) residing in the host computer, in the 
software contained in the printer 10, in the printer hardware 
itself, or in any combination of these locations. For example, 
if the printer has the capability of rasterizing a page 
description, such as an Adobe Systems, Inc. PostScript® 
printer, or it has the capability of halftoning the rasterized 
page description, the printing process of flow chart 50 may 
occur partially or entirely within the printer 10. In any case, 
at one stage in the process, data defining the selected image 
42 is transmitted from the host computer to the printer 
hardware (e.g., the printer pens 20, 22, the drive mechanism 
for controlling carriage 24, and the paper handling system 
14) and the image 42 is printed on sheet 15. 

The types of data transmitted from the computer to the 
printer 10 typically varies depending upon the types of 
image components under consideration, For example, the 
textual components 44 may be transmitted as bit-mapped 
data or ASCII text characters, while the photographic image 
48 is typically transmitted as bit-mapped or pixel-mapped 
data. The graphs 45 and 46 arc generally rectilinear objects, 
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and may be transmitted as bit-mapped data or as geometric la addition to the page description 52, other inputs may be 
shapes in a mathematical format with definitions for pattern, provided to the illustrated embodiment of FIG. 3. While the 
fill type, arcs, etc., together with boarder locations, rasterizing step 60 may select a resolution which balances 
thickness, titles and the like. throughput and print quality, these parameters may be sup- 
Thus, in general the printed image components (textual 5 plied as other inputs 76, such as user or printer inputs 
44, grayscale 45, color graphic 46, or photographic 48) may supplied as an input signal 78. For example, a user may 
distinguished based upon the data format received by the sc icct the print quality as "best," "normal 1 * or "draft," with 
printer 10 from the computer. It is apparent that occasionally corresponding tradeoffs of lesser or greater throughputs, 
there will be exceptions, such as graphs 45, 46 which have respectively. Another user input may be the type of print 
been constructed by the user through bit-map or pixel-map 10 me< ii um . Alternatively, these inputs 76 may be provided 
techniques, which may then be interpreted as photographic totaUy ^ ^ part by ^ computer, f or instance, the type of 
images. Alternatively, each bit-map may be analyzed to print ^ OT peQS 20, 22. 

deternune its c<^sition such as by spatial frequency In the illustrated embodiment of FIG. 3, the various types 

analysis and/or deternunatxon of the number of unique generated durmg me prmtmg operation, h« 

colors However, the vast majority of people form busmess u ^ 8 extracted and conditioned^then injected into 

charts 45, 46 using graphics programs, as opposed to bit- sequen t stages of the printing process, or used to alter the 

map programs so on 1. practical basis any coniusion of ^ to be extracted, 

graphics as photographic images is expected to be minimal, JgJ^ and men processed according to subsequent steps. 

Flow diagram 50 illustrates an embodiment of a method ^ ^ embodiment for printer 10, there are three 

of the present invention using printer 10 in an environment 20 ^ ^ extraction and conditioning segments, which may 

provided by Apple Computer, Inc/s QuickDraw® graphics be Unked ^ ^ showQ ^ ^ mst[ ^ cmbodi . 

language. The illustrated printer 10 is Hewlett-Packard men t interacts at each stage 52, 60, 68 and 75, interaction at 

Company's DeskWriter® 560C model Inkjet printer, which les§ man ^ of me available ^ges may also be useful in 

has four stages for generating the hardcopy output 40. In the gome 

first stage, in a page generating step 52, a page description 25 ^ ~7\ , _ . . . . ... . eo 

is gensatkfor exa4le,by a use^ra soflWe application * J* fraction * *e tecnpbo* signal 58, 

uJng a high levelg^phics language, such as the Post- wta* u> supplied to a page su.bst.es ejecting -ddirao- 

Script® graphics language sold by Adobe Systems, Inc., or tensing step 80 In step 80, the page desenption date 56 is 

Apple Corner, m^sVcWaw® graphics primitives coUected as statistics concernmg the selectedimage 42. The 

(shown in the illustrated embodiment). The generating step 30 °f d^cription may be charac- 

52 produce, an output data stream signal 54 which may be ^^^^^t^^^^ 

accumulated as page description data 56. «• "l."**? ■ ttrih ^' S , U J* ^'^J* 
. . . . T - 0 . * color, fill color, hue thickness, and the like. Other statistics 

^ P Jf,t S £ PtKm ^ 5»./epresentetive of the accu- ^fcMwnMionnhwtctiUisusc&onthowc, 

mulated data 56 comprises an uiput to the second stagey ^ * as ^ ^ such as text size, color a^d 

rastenzmg page description step 60. This rastenziiig step 60 33 ja,^ uscM to gathcr other infonnatioa, such 

may be conducted in a variety of conventional manners * , * ... . . . - . ^ 

, * , ^ 11t4 , .. ^r, , f . „ . as whether text is next to, or on top of colored regions. 

known to those skilled in the art For example, the raster- r ... » A 

izing step may include choosing a resolution which yields a Additional statistics collected and characterized in step 80 

selected optimum balance of throughput and print quality, may include the presence of any scanned images 48, which 

Alternatively, these parameters may be supplied as user or 40 o^n represent photographs. Other statistics regarding the 

printer inputs, as discussed further below. A data stream selected image 42 may include recording which black 

signal 62 output of the rasterizing step 60 may be accumu- objects touch color objects, which regions contain only 

lated as rasterized page image data 64. black <*>fc is > and which ™& 0DS contain a ™*torc of black 

Therasterized data 64 may be supplied as arasterized data ™* ^loi objects that ; touch each ot^ This infoir^on 

signal 66 to the third stage for generating the hardcopy 45 may be useM for bleed control on ^O^ r^ers that have 

output 40, a halftoning step 68 for halftoning the page ^ e * te ™* 0as *° b ** <^ ^ 

image. The halftoning step 68 may be accomplished in a (p^) inks At this initial collec^ngstep 80, statistics may 

variety of conventional manners known to those skilled in f °. be gathered to define the . bocuuhijg ; areas of regions 

the art, including processes such as halftoning to different ? a ™8 ^^ba^tm^dM^u^^ 

rixeidepms,ormo%erequiredto support different r^rdware 50 Jf ****T£?? "tT? 9 !S5" ^ ^ ™J 

printing modes. A data stream signal 70 output of the benefit from halftoning techniques differing from thoseused 

halftoning step 68 may be complied as halftonedpage image 011 me scanned Photograph 48. 

o^ta 72. Beyond characterizing certain features of the components 
A halftoned data signal 74 represents the halftoned data 45, 46 and 48, step 80 may also characterizes image 42 
72, and is supplied to the fourth stage, a final printing step 55 according to the subsequent steps which may be employed 
75. This printing step 75 may be translated by a portion of in certain regions. For instance, step 80 may characterize the 
controller 30 into instruction signals recognizable to the type of postprocessing the photographic region 48 requires 
printer hardware to drive the paper handling system 14, the * ^g^V out of focus and could benefit from sharp- 
pen carriage 20, and the pens 20, 22 to selectively apply ening. Also, a low resolution photograph may benefit from 
black and color inks to the print medium 15 to compose the 60 resolution enhancement or synthesis techniques. Color bid- 
selected image 42. It is apparent to those skilled in the art ance and contrast are further examples of statistics which 
that other hardcopy print devices may have more or less mav be measured and characterized in step 80 for later 
steps than the four stages 52, 60, 68 and 75 illustrated. The correction. 

concepts illustrated by FIG. 3, and as described further In step 80, it may also be useful in controlling subsequent 

below, may be modified accordingly to accommodate the 65 image processing variables, to determine whether image 48 

varying number of printer steps involved for a specific is actually a scanned photograph or a synthetic computer 

hardcopy printing device. generated image. The number and types of colors used on 
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the page may be counted in step 80 to take advantage of 
rendering the page at the lowest possible pixel depth for 
maximum throughput, or if only neutral (gray) colors 45 are 
detected, the page may be treated by printer 10 as a grayscale 
page rather than a color page to maximize both quality and 
throughput 

When printing one or a sequence of plural hardcopy 
pages v step 80 may also collect statistics for each page as a 
whole, such as the Dumber of elements, or the number of 
color elements on each page. Upon completion of all or 
portions of step 80. an output signal 82 carries the charac- 
terized data output of step 80 for accumulation as first 
characterization data 84. 

This first characterization data 84 is supplied by signal 86 
to a controlling rasterization parameters step 88. In the 
controlling step 88, the first characterization data 86 is used 
to generate a rasterization control signal 90, which is then 
supplied as an input to the rasterizing page description step 
60. The first characterization data 86 may also be supplied 
to a modifying page description step 92. 

In the modifying step 92, the first characterization data 
signal 86 is used as an input to modify (he page description 
for use on a specific type of hardcopy print device 10. Thus, 
the modifying step 92 may be different for an Inkjet printer 
10 (FIG. 1) than that for an electrophotographic printer (not 
shown), for example, such as Hewlett Packard Company's 
Lasesjet® printers, because these two devices have different 
print characteristics. The modifying step 92 provides an 
instruction signal 94 which may operate on the page descrip- 
tion data 56 to modify it in accordance with the type of 
printer in use. As with modifying step 92. controlling steps 
88, 104, and 120, modifying steps 108 and 124, and char- 
acterization steps 80, 96, and 112 are all tailored to the 
unique characteristics of each type of hardcopy print device. 

For instance, if black to color bleed control is to be 
handled on an object by object basis, then black objects that 
touch color, or fall within color regions, may have colors 
modified by step 92. In this case, step 92 insures the images 
are printed with the correct combination of CMYK to 
provide a good quality black without bleed into the **process 
black" of the (mixture of cyan, magenta and yellow) color 
regions. Another option is to use the black and color regions 
to control post processing of the black pixels in a later step 
to ensure process black is used where needed. 

In another example, step 92 may adjust the line widths to 
provide maximum quality and accuracy of reproduction by 
the hardcopy output device. For instance, on the color inkjet 
printer 10, color lines that are one pixel wide and designated 
to be produced with halftoned colors often must be thick- 
ened to a two-pixel width to ensure that enough halftoned 
pixels are printed to fully render the line in its true color. In 
contrast, black lines or lines produced with solid colors 
usually do not require thickening. 

In another example, step 92 could process photographic 
images with digital filters to sharpen the image, enhance 
edges, and remove noise from the image. 

The control step 88 produces the control signal 90 based 
upon the current page characterization. Thus, the rasterizing 
step 60 may be modified to provide different rasterizations 
according to which region, textual 44, graphic 45, 46, or 
photographic 48, is being rasterized by step 60. Thus, each 
of the regions 44-48 may be rasterized in a customized 
fashion, according to image type. 

The rasterization controlling step 88 may address other 
concerns. For example, if the page only contains scanned 
images 48 that are of relatively low resolution, the whole 
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page may be rasterized at the lower resolution to maximize 
throughput without reducing print quality. If the page con- 
tains only grayscale shades as in graphic 45, then the page 
may be rasterized on the order of eight bits per pixel, using 
5 a gray palette for maximum throughput and quality. 

As another example, the color objects 46, 48 may be 
tagged with color matching information (e.g. ColorSync® 
color matching produced by Apple Computer, Inc.), or if not 
so tagged, step 88 may perform this color matching opera- 
10 tion before rasterization. Each color object 46, 48 may be 
color matched depending on what type of object it is. If these 
objects have already been tagged with color matching 
preferences, then these preferences may override automatic 
tagging commands of step 88, particularly if the commands 
15 were manually set, which ensures that the producer of the 
page description may control the type of color adjustment 
for each element on the page. 

The color matching schemes employed by step 88 typi- 
cally vary by object type. Photographic images 48 may be 
20 color matched with a human perceptual color matching 
scheme that ensures the colors match our memory colors 
(i.e. grass is the right shade of green and flesh colors come 
out correctly), provides good tone reproduction, and adjusts 
for colors that are outside of the normal gamut of colors 
25 produced by printer 10 for a lifelike image. For small text 
and line art, step 88 may adjust the colors for greater 
intensity and/or changes in hue so the resulting image is 
sharp, vivid and clear. For business graphics and business 
charts, step 88 may match colors for a pleasing combination 
30 of vibrancy, while also limiting the colors to prevent over- 
saturation or bleeding through the page, depending upon the 
actual printing technology employed by printer 10. 

Step 88 may also operate to print objects with borders of 
35 a different intensity than the interior to provide both good 
edge definition and the required area saturation. This can be 
accomplished in QuickDraw® implementations, for 
instance, by modifying the border color in a different manner 
than the interior color. Alternatively, step 88 may divide a 
^ single object with a single color specification into two 
objects, then treat the border object as having one color, and 
the interior fill object as having a second color. 

In a second data extraction and conditioning segment, the 
rasterized image data 64 is extracted via signal 66 to provide 
45 an input to a collecting and enhancing step 96. In step 96, 
additional statistics regarding the rasterized page image, 
sometimes also referred to as a bitmap, are collected and 
used to enhance the page first characterization data 84, 
received via signal 86. Using the rasterized data of the first 
50 characterization 84, allows additional refinement in the 
characterization of image 42. The output of the enhancing 
step 96 is supplied as signal 98 to define a second charac- 
terized data set 100. 
The second characterized data set 100 is provided as 
55 signal 102 to a controlling halftoning parameters step 104. 
The output of step 104 is provided as a halftoning control 
signal 106 to the halftoning step 68. The signal 102 may be 
supplied as an input to an adjusting pixel image step 108 for 
post processing the rasterized page image data 64. In the 
60 adjusting step 108, the resulting pixel image signal 66 may 
be adjusted according to the specific attributes of the printer 
10. As with the modifying step 92 above, the attributes of an 
inkjet printer 10 may be different from those of other types 
of hardcopy output devices, such as a plotter. For example, 
65 the resulting pixel image may be adjusted to include chang- 
ing the colors to account for inaccuracies in the color 
reproduction of printer 10. For example, different types of 
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ink formulations within the pens, particularly the color pen 
20, may need adjustment to account for slight variations in 
hue. 

The output of the adjusting step 108 is provided as a pixel 
adjustment control signal 110, which adjusts the rasterized 
image data 64 in this matter. Further color adjustments on 
the page may be accomplished by step 108. For instance, 
photographic regions 48 may be further adjusted now, and 
large regions of high saturation may be adjusted to control 
the amount of ink subsequently printed at step 75. 

The post processing step 108 may include digitally fil- 
tering photographic regions 48 for smoothing, sharpening, 
resolution enhancement and synthesis as needed. This fil- 
tering aspect of step 108 may only operate on photographic 
regions 48 which maximizes throughput and without modi- 
fying other areas of the page, such as the text 44, that would 
not benefit from digital filtering. 

Other examples of functions which may be performed by 
the post processing adjusting step 108 include separating 
black and color areas for bleed control, if not done in 
previous steps at the object leveL Additionally, steps 104 or 
108 may smooth black data with a resolution enhancement 
algorithm. This step is particularly useful for printers like the 
DeskWriter 560C that have the capability to support a higher 
black resolution (600x300 DPT) than color resolution (300x 
300 DPI). 

In step 104, the halftoning parameters are controlled 
based upon the second characterized data 100. For example, 
the halftoning step 68 may halftone the resulting resolution 
specific image for a specific pixel depth. Step 104 may 
accomplish this by digitally halftoning the image 42 using 
the appropriate halftoning technique far each region of the 
page. For instance, if users prefer business graphics 46 to be 
halftoned with a different technique than scanned photo- 
graphs 48, then step 104 may accomplish this distinction by 
using the statistics collected from the page description and 
accumulated as data 84. 

In step 96 the rasterized image or bitmap data 64 may be 
scanned to collect a variety of additional statistics. For 
example, if black to color bleed control was not done on an 
object by object basis, step 96 may scan the bitmap to 
separate the pure black regions from the regions that contain 
a mixture of touching black and color pixels. This informa- 
tion may be used in step 104 to halftone the black that falls 
within the color regions as a process black (mixture of cyan, 
magenta and yellow) and that which falls outside of the color 
regions as a true black In step 96, the pure black regions 
may also be separated from the color regions for special 
processing. For example, as described earlier, resolution 
enhancement or smoothing may be applied in step 104 to the 
black regions to enhance the edge definition. 

In a third data extraction and conditioning segment, a 
collecting and enhancing step 112 further enhances the data 
describing the selected image 42 using the halftoned page 
data 72, received via signal 74, in combination with the 
second characterization data 100, received via signal 102. 
The output of enhancing step 112 is provided as signal 114 
to provide a third characterization data set 116. In step 112, 
the density of pixels on the page may be measured and used 
to control printing characteristics to ensure the best quality 
and highest throughput For instance, if the page has a large 
area of dense color pixels, step 112 may direct printing with 
a higher shingling mode to reduce color bleed, or the printer 
may retain the following page longer before dropping it onto 
this dense page to assure adequate drying time. The term 
"shingling* 1 refers to a mode of operation for printer 10 
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where the printer lays down only a percentage of the total 
ink dots available in a given print pass, and makes several 
passes to complete a raster. Shingling hides most nozzle 
inconsistencies and reduces the ink bleed. Also, this mea- 

5 suring of the amount of ink by step 112 may be used to warn 
when the ink cartridges 20, 22 arc running low. 

The third characterization data set 116 is supplied by 
signal 118 to a controlling of printing parameters step 120. 
Based upon this final characterization 116, controlling step 

to 120 provides a printing control signal 122 to the print step 
75. The signal 118 may also be supplied to a processing 
halftoned data step 124. In the processing step 124, the 
halftoned data may be processed to prepare it for the specific 
hardware of printer 10. It is apparent that this processing 

!5 step may vary depending upon the type of printing device 
used, such as an inkjet printer 10 which has the capability to 
support a higher black resolution (600x300 DPI) than color 
resolution (300x300 DPI), versus a hardcopy printing device 
having the same resolution for both black and color. In this 

20 case, the inkjet printer could benefit from having the black 
data smoothed with a resolution enhancement algorithm, if 
not already done in an earlier step. The output of the 
processing step 124 is supplied as a processing control 
signal 126 to process the halftoned page image data 72 in 

25 this manner. 

In step 120, areas that are pure black may be printed with 
different printer settings to maximize throughput, while 
color regions may be printed with settings to maximize 
quality. For instance, if the top half of a page contains only 

30 black text 44, men it may be printed without shingling (best 
for text), while color graphics 46 at the bottom of the page 
may require 50% shingling (best for color graphics) to print 
without noticeable defects. With earlier printing methods, 
the whole page would have to be printed with 50% shingling 

35 which slowed down the printer and possibly reduced the 
quality of the text at the top of the page. 

The controlling step 120 may instruct printer 10 to hold 
onto a page before dropping it onto the previously printed 

^ page based upon the amount of ink on the previous page. 
Step 120 may select compression modes based on the type 
of data on the page to maximize throughput and minimize 
quality defects caused by the printer stopping printing and 
then restarting, a phenomenon often caused by a lack of data 

45 in the printer's input buffer. In another example of step 120, 
shingling may be controlled on a page by page basis, or on 
a region basis for pages that benefit from different shingling 
levels on different areas of the page. 
Thus, the illustrated emtodiment of this method controls 

50 the printing process in an optimal fashion by collecting 
statistics at steps 80, 96 and 112 from at the respective stages 
of print data 56, 64 and 72 on the type of document that is 
being printed. The steps 80, 96 and 112 use the collected 
data to characterize the images appearing on the hardcopy 

35 output 40 as textual images 44, grayscale images 45, color 
graphic images 46 or photographic images 48. At each stage, 
additional information is collected to refine the character- 
ization of the document and reflect the page description 
transformation at each stage 52, 60 and 68 of the printing 

go process. Additional information is extracted from subse- 
quent stages and combined with the characterization from 
the previous stages to enhance this refinement 

Each of the characterized data sets 84, 100, 116 are linked 
together so that earlier characterizations are used in subse- 

65 quent characterization steps. Advantageously, the illustrated 
characterization of the hardcopy output 40 allows the indi- 
vidual graphics elements 45, 46 and 48, as well as text 44, 
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to be controlled independently. For example, the colors of 
the business graphics 45, 46 may be processed differently 
from those of the scenic photographic image 48. Thus, bright 
vivid colors may be used for the graphics 45, 46, whereas 
more realistic subtler tones may be used for the photo- 5 
graphic image 48. 

Other data flow control schemes may also be imple- 
mented. For example, in step 96 of FIG. 3, the pure black 
regions may be separated from regions having touching 
black and color pixels . The black ink data may be transferred 10 
via signal 98 to the second characterized data 100, while the 
color and processed black ink data may be returned to the 
main print stream via a return signal 66 for subsequent 
processing as a portion of rasterized page image data 64 at 
step 68. Alternatively, the black ink data may be separated 15 
and directed through steps 112 and 124 for addition to the 
halftoned page image data 72. 

FIG. 4 illustrates a screen display 130 of a prior art printer, 
particularly, the Hewlett Packard Company's DeskWriter 
550C model inkjet printer using driver software version 2.0. 
In the prior art system of screen 130, the color blending must 
be separately selected, here illustrated as being selected as a 
pattern 132. The color matching feature must also be 
selected, here illustrated as a standard selection 134. The 
print cartridges in use arc also separately selected, here as 
black and color cartridges 135. An intensity selection 136 of 
the colors in another choice for the user to make. And finally, 
the operator must decide whether or not to minimize black 
and color bleed by either checking block 138 or leaving it 
blank as shown. 

FIG. 5 illustrates an embodiment of a monitor screen 
display 140 in accordance with the present invention. In 
particular, the screen display 140 shown appears on Hewlett 
Packard Company's DeskWriter® model 560C inkjet 3J 
printer using driver software version 5.0, which has the 
configuration generally illustrated by printer 10. The illus- 
trated screen 140 includes an intensity selection 142, a 
halftoning selection 144, a bleed control selection 146 and 
a color matching selection 148. If customized color is ^ 
desired, and an operator wishes to separately adjust these 
characteristics, a variety of selections (not shown) are 
available, some of which may be in the same manner as 
illustrated in the prior art systems. 

Advantageously, software embodying one form of the 45 
method of the present invention may be used to upgrade 
earlier printers originally sold without these capabilities. For 
example, the illustrated version 5.0 driver software may be 
used to upgrade the Hewlett Packard Company's 
DeskWriter® model 55 0C inkjet printer, described above 50 
with respect to FIG. 4. 

One distinct advantage of the present invention is the 
availability of the "auto" selection for adjustments 142-148, 
as shown. This auto selection refers to the automatic color 
matching scheme illustrated by flow chart 50 which allows 55 
the various image regions 44 4 8 to be distinguished and 
tailored for color matching as described above. The require- 
ments of the vast majority of users for clear vivid business 
graphics 46 with lifelike photographic images 48, may be 
easily obtained without requiring user involvement in setting 60 
the various color composition factors. Thus, sharp vivid 
hardcopy outputs 40 are obtained with minimal user 
involvement. 

Moreover, in other screen displays (not shown), the 
system of the present invention also allows for the selection 65 
of printing colors in image 42 as a gray scale, a feature 
which was also available in earlier systems using only black 



ink. A grayscale version of the hardcopy output 40 may be 
particularly useful when transmitting the hardcopy image 
via facsimile for receipt on a black ink only facsimile 
machine. Other uses for a grayscale image include photo- 
copying on a black ink only photocopy machine, and print- 
ing quick proof or draft copies of color documents 

The steps and processes of printer 10 described may be 
re-ordered. Other modifications may be adapted depending 
upon the printer involved, for instance, color matching may 
occur at the object level and/or at the rasterized page image 
level. Other steps may be added or modifications made to 
flowchart 50. For example, the statistics collection resulting 
in characterizations 84, 100 and 116, may be fed back 
upstream to affect future output or to cause the process to 
restart with the new information about the current page. For 
instance, if at the end of the process, step 75, it is discovered 
that the page that contains too many printed dots, then the 
process 50 may begin again with the image 42 being color 
adjusted to reduce the saturation of the page and hence the 
number of printed dots. Thus, operation of a hardcopy 
printer, such as printer 10, in accordance with the present 
invention enables the rendering and printing parameters to 
be optimized for each type of document. In fact, each 
component of a document such as those illustrated at 44-48, 
that comprise a mix of graphic elements may be individually 
optimized for each sheet printed. 

We claim: 

1. A method of controlling printing of a hardcopy using a 
hardcopy printing device having print characteristics, the 
method comprising the steps of: 

supplying a page of a printing medium to the hardcopy 
printing device; 

instructing the hardcopy printing device to print on the 
page a selected image having a combination of at least 
two elements comprising (a) textual material, (b) 
graphic images, or (c) photographic images; 

distinguishing each element of the selected image as 
being either (a) textual material, (b) a graphic image, or 
(c) a photographic image; 

collecting statistics for each distinguished element of the 
selected image; and 

in response to the distinguishing and collecting steps, 
adjusting the instructing step for each of the elements 
to be printed on the page to instruct the hardcopy 
printing device to (a) print any textual material accord- 
ing to a first set of parameters, (b) print any graphic 
image according to a second set of parameters, and (c) 
print any photographic image according to a third set of 
parameters. 

2. A method according to claim 1 wherein: 

the instructing step comprises plural printing stages; and 
the collecting and adjusting steps are repeated at each of 
the plural printing stages of the instructing step. 

3. A method according to claim 2 wherein the collecting 
and adjusting steps comprise collecting statistics based upon 
an output of any previous adjusting steps. 

4. A method according to claim 3 wherein at least one of 
the elements of the selected image may be a color image, 

5. A method according to claim 4 wherein: 

the hardcopy printing device comprises an inkjet printer 

having color printing capability; and 
the adjusting step comprises adjusting the color printing 

of the inkjet printer. 

6. A method according to claim 1 wherein: 

the instructing step comprises generating a data format 
representative of the selected image; and 
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the distinguishing step comprises distinguishing the data 
format for each element as either pixel maps of data, 
geometric data, or textual data. 

7. A method according to claim 1 wherein: 

(he instructing step comprises the step of generating a 5 
page description of the selected image; and 

the method further includes the step of modifying the 
page description in accordance with the print charac- 
teristics of the hardcopy printing device. 

8. A method according to claim 7 wherein the modifying 
step comprises the step of imposing a minimum line thick- 
ness on the page description. 

9. A method according to claim 7 wherein: 

the instructing step comprises the step of rasterizing the 15 
page description to provide a pixel image; and 

the method further includes the step of adjusting the pixel 
image in accordance with the print characteristics of the 
hardcopy printing device to provide a resolution spe- 
cific image. 20 

10. A method according to claim 9 wherein the step of 
adjusting the pixel image comprises the steps of adjusting 
the colors in the pixel image. 

11. A method according to claim 9 wherein the adjusting 
step comprises the steps of: 25 

balancing two characteristics of the hardcopy printing 
device comprising a throughput characteristic and a 
print quality characteristic, wherein an increase in the 
throughput characteristic is achieved at a decline in the 
print quality characteristic, and an increase in the print 30 
quality characteristic is achieved at a decline in the 
throughput characteristic; and 

selecting a resolution in response to the balancing step. 

12. A method according to claim 9 wherein: 

35 

the instructing step comprises the step of halftoning the 
resolution specific image to provide halftoned print 
data; and 

the method further includes the step of processing the 
halftoned print data in accordance with the print char- ^ 
acted sties of the hardcopy printing device. 

13. A method according to claim 1 wherein: 
the instructing step comprises the steps of: 

generating a page description of the selected image 

using a high level graphics language; 45 
rasterizing the page description for a selected resolution 

to provide a pixel image; and 
halftoning the resolution specific image for a selected 
pixel depth to provide halftoned print data; and 
the method further includes the steps of modifying the 50 
generated page description, adjusting the rasterized 
pixel image to provide an enhanced image, and pro- 
cessing the halftoned print data, in accordance with the 
print characteristics of the hardcopy printing device. 

14. A method according to claim 1 wherein: 55 
the elements of the selected image comprise at least one 

grayscale image; and 
the step of collecting statistics further comprises the step 
of collecting statistics for each grayscale image. 

15. A method according to claim 14 wherein: 

the hardcopy printing device comprises an inkjet printer 
having monochrome printing capability; and 

the adjusting step comprises adjusting the monochrome 
printing of the inkjet printer for each element of the 
selected image. 
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16. A method according to claim 15, wherein: 

the hardcopy printing device comprises an inkjet printer 
also having color printing capability; and 

the adjusting step also comprises adjusting the color 
printing of the inkjet printer. 

17. A method according to claim 1 further including the 
steps of printing a sequence of plural hardcopy pages, and 
collecting statistics for each page. 

IS. A hardcopy printing device for printing on a page of 
a print medium a selected image having a combination of at 
least two elements comprising (a) textual material, (b) 
graphic images, or (c) photographic images, the hardcopy 
printing device comprising: 

a chassis; 

a print medium handling system housed in the chassis for 
supplying the print medium page to a printing zone; 

a printhead that selectively deposits ink on the print 
medium page in the printing zone in response to a 
control signal; and 

a controller which generates the control signal in response 
to a data input denning a page description comprising 
a selected image having a combination of at least two 
elements comprising (a) textual material, (b) graphic 
images, or (c) photographic images, with the data input 
including statistics which are collected for each ele- 
ment of the selected image, with the data input having 
portions extracted and adjusted to characterize each of 
the elements to be printed on the page as either textual 
material, a graphic image or a photographic image to 
enhance the selected image when printed. 

19. A hardcopy printing device according to claim 18 
wherein the controller extracts and adjusts the portions of 
the data input to characterize each of the plural elements to 
be printed on the page as either textual material, a graphic 
image or a photographic image. 

20. A hardcopy printing device according to claim 18 
wherein the printhead comprises an inkjet printhead, and the 
hardcopy printing device comprises an inkjet printer. 

21. A hardcopy printing device according to claim 20 
wherein: 

said printhead comprises a black ink printhead; and 
the inkjet printer further includes a second printhead 
comprising a color ink printhead. 

22. A method according to claim 1 wherein the distin- 
guishing step further includes the step of distinguishing a 
region of the selected image where two different plural 
elements touch one another. 

23. A hardcopy printing device according to claim 20 
further comprising a printhead carriage system that propels 
the inkjet printhead across the printing zone to selectively 
deposit ink on the print medium page in response to a control 
signal. 

24. A hardcopy printing device according to claim 18 
wherein the controller generates the control signal to instruct 
the hardcopy printing device to (a) print any textual material 
according to a first set of parameters, (b) print any graphic 
image according to a second set of parameters, and (c) print 
any photographic image according to a third set of param- 
eters. 

* # * * * 
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